Measuring and transmitting emotional feedback in group teleconferences

ABSTRACT

A system and method are disclosed for generating a teleconference space for two or more communication devices using a computer coupled with a database and comprising a processor and memory. The computer generates a teleconference space and transmits requests to join the teleconference space to the two or more communication devices. The computer stores in memory identification information for each of the two or more communication devices. Each of the two or more communication devices stores audiovisual data pertaining to one or more users associated with each of the two or more communication devices. Each communication device converts the audiovisual data into facial expressions data, generates emotions data from the facial expressions data, generates attention data from the emotions data, and transmits the attention data from the communication device to the computer. The computer displays the attention data.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure is related to that disclosed in the U.S.Provisional Application No. 62/867,361, filed Jun. 27, 2019, entitled“Measuring and Transmitting Emotional Feedback in GroupTeleconferences.” U.S. Provisional Application No. 62/867,361 isassigned to the assignee of the present application. The subject matterdisclosed in U.S. Provisional Application No. 62/867,361 is herebyincorporated by reference into the present disclosure as if fully setforth herein. The present invention hereby claims priority under 35U.S.C. § 119(e) to U.S. Provisional Application No. 62/867,361.

TECHNICAL FIELD

The present disclosure relates generally to electronic teleconferencingsystems and more specifically to measuring and transmitting theemotional feedback of users participating in teleconference systems.

BACKGROUND

Teleconference systems may utilize communication networks, including butnot limited to the internet, to connect communication systems andcommunication devices such as computers, tablet computers, and/orsmartphones. Teleconference systems may permit communication systems toshare visual imagery and audio data associated with a speaking user withother communication systems. However, teleconference systems may notprovide a speaking user with useful audience feedback as the speakinguser delivers a teleconference presentation, and may prevent thespeaking user from assessing the current attention level and emotionalstate of the audience participating in the teleconference presentation.

SUMMARY

The following presents a simplified summary of the disclosure in orderto provide a basic understanding to the reader. This summary is not anextensive overview of the disclosure and it does not identifykey/critical elements of the invention or delineate the scope of theinvention. Its sole purpose is to present some concepts disclosed hereinin a simplified form as a prelude to more detailed descriptionspresented below.

In embodiments of the disclosed subject matter, the unique systems andmethods described herein make use of an exemplary system and method tomeasure and transmit emotional feedback in group teleconferences.Embodiments of the disclosed subject matter include two or morecommunication systems, including but not limited to tablet computers orsmartphones, and a computer coupled with a database and comprising aprocessor and memory. The computer generates a teleconference space andtransmits requests to join the teleconference space to the two or morecommunication systems. The computer stores in memory identificationinformation for each of the two or more communication systems. Each ofthe two or more communication devices stores audiovisual data pertainingto one or more users associated with each of the two or morecommunication devices

In embodiments of the disclosed subject matter, each communicationdevice converts the audiovisual data into facial expressions data,generates emotions data from the facial expressions data, generatesattention data from the emotions data, and transmits the attention datafrom the communication device to the computer. The computer displays theattention data.

These and other features of the disclosed subject matter are describedin greater detail below.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete understanding of the present invention may be derived byreferring to the detailed description when considered in connection withthe following illustrative figures. In the figures, like referencenumbers refer to like elements or acts throughout the figures.

FIG. 1 illustrates an exemplary teleconference system, according to afirst embodiment;

FIG. 2 illustrates the cloud system of FIG. 1 in greater detail,according to an embodiment;

FIG. 3 illustrates an exemplary communication device of FIG. 1 ingreater detail, according to an embodiment;

FIG. 4 illustrates an exemplary method of displaying the qualitativeattention values of one or more communication devices, according to anembodiment;

FIG. 5 illustrates an exemplary teleconference system executing themethod of FIG. 4, according to an embodiment;

FIG. 6 illustrates a teleconference display, according to an embodiment;

FIG. 7 illustrates data points assigned by a facial analysis module to areal-time visual stream, according to an embodiment;

FIG. 8 illustrates the process by which the facial analysis modulegenerates emotions data based on facial structure data points stored infacial expressions data, according to an embodiment;

FIG. 9 illustrates the process by which an emotions analysis modulegenerates attention data from emotions data, according to an embodiment;and

FIG. 10 illustrates a host display of a teleconference space, accordingto an embodiment.

DETAILED DESCRIPTION

Aspects and applications of the invention presented herein are describedbelow in the drawings and detailed description of the invention. Unlessspecifically noted, it is intended that the words and phrases in thespecification and the claims be given their plain, ordinary, andaccustomed meaning to those of ordinary skill in the applicable arts.

In the following description, and for the purposes of explanation,numerous specific details are set forth in order to provide a thoroughunderstanding of the various aspects of the invention. It will beunderstood, however, by those skilled in the relevant arts, that thepresent invention may be practiced without these specific details. Inother instances, known structures and devices are shown or discussedmore generally in order to avoid obscuring the invention. In many cases,a description of the operation is sufficient to enable one to implementthe various forms of the invention, particularly when the operation isto be implemented in software. It should be noted that there are manydifferent and alternative configurations, devices and technologies towhich the disclosed inventions may be applied. The full scope of theinventions is not limited to the examples that are described below.

As described more fully below, embodiments of the following disclosurerelate to measuring and transmitting the emotional feedback of usersparticipating in a group teleconference. Embodiments of the followingdisclosure generate a teleconference space that includes a plurality ofseparate communication systems, each of which comprises one or morecommunication devices controlled by an individual user or group ofusers. Embodiments of the teleconference space comprise a visualcomponent, which may include video imagery, and an audio component,which may comprise audio from a speaking user. Embodiments transmit thevisual component and the audio component of the teleconference space asa single outbound teleconference stream to the plurality of separatecommunication systems, each of which displays the outboundteleconference stream to the one or more associated users. Each of theplurality of communication systems measures and analyzes the emotions ofan associated user, and transmits this information to one or more otherlocations in the teleconference space.

Embodiments of the following disclosure enable a user to receivereal-time information regarding the emotions and attention engagement ofthe one or more users associated with the plurality of separatecommunication systems participating in the teleconference space.Embodiments may permit speaking users to tailor their teleconferencepresentations based on real-time user emotional and/or attentionfeedback.

FIG. 1 illustrates exemplary teleconference system 100, according to afirst embodiment. Teleconference system 100 comprises one or more cloudsystems 110, one or more communication systems 120 each of whichcomprises one or more communication devices 122, network 130,communication links 140-150, and teleconference space 160. Although oneor more cloud systems 110, one or more communication systems 120 a-120n, one or more communication devices 122 a-122 n, single network 130,communication links 140-150, and single teleconference space 160 areshown and described, embodiments contemplate any number of cloud systems110, communication systems 120, networks 130, communication links140-150, or teleconference spaces 160, according to particular needs.

In one embodiment, cloud system 110 comprises administrator 112 anddatabase 114. Administrator 112 generates teleconference space 160 inwhich one or more communication systems 120, each comprising one or morecommunication devices 122 and one or more associated users, mayparticipate. Database 114 comprises one or more databases or other datastorage arrangements at one or more locations local to, or remote from,cloud system 110. In one embodiment, one or more databases 114 iscoupled with the one or more administrators 112 using one or more localarea networks (LANs), metropolitan area networks (MANs), wide areanetworks (WANs), or network 130, such as, for example, the Internet, orany other appropriate wire line, wireless link, or any othercommunication links 140-150. One or more databases 114 stores data thatis made available to and may be used by one or more administrators 112according to the operation of teleconference system 100. According toembodiments, administrator 112 hosts and runs one or more runtimeprocesses associated with cloud system 110.

According to embodiments, each of one or more communication systems 120comprises one or more associated users such as, for example, anindividual person or customer, one or more employees or teams ofemployees within a business, or any other individual, person, group ofpersons, business, or enterprise which communicates or otherwiseinteracts with one or more separate communication systems 120. Althoughan exemplary number of communication systems 120 are shown anddescribed, embodiments contemplate any number of communication systems120 interacting with network 130 and one or more cloud systems 110according to particular needs. As an example only and not by way oflimitation, teleconference system 100 may allow up to 50, 100, 500, or1,000 separate communication systems 120 to join and participate inteleconference space 160 simultaneously.

Each of one or more communication systems 120 comprises one or morecommunication devices 122, such as, for example, cellular phones orsmartphones, desktop computers, laptop computers, notebook computers,tablet-type devices, terminals, or any other communication device 122capable of receiving, transmitting, and displaying audiovisualinformation through network 130. In an embodiment, each of one or morecommunication devices 122 may comprise an audiovisual recording device,such as a computer camera and microphone, and an audiovisual displaydevice, such as an electronic display screen and one or more speakers.The audiovisual display devices permit each of the one or more usersinteracting with each of one or more communication devices 122 to seeand hear visual component 162 and audio component 164 of teleconferencespace 160. The audiovisual recording devices record audiovisualinformation regarding the one or more users associated with one or morecommunication devices 122. In addition, each of one or morecommunication devices 122 may comprise an input device, such as akeyboard, mouse, or touchscreen.

Each of one or more communication devices 122 that comprise each of oneor more communication systems 120 may be coupled with othercommunication devices 122, as well as one or more cloud systems 110, bynetwork 130 via communication links 140-150. Although communicationlinks 140-150 are shown connecting each of one or more communicationsystems 120, respectively, to network 130, embodiments contemplate anynumber of communication links 140-150 connecting any number ofcommunication systems 120 or communication devices 122 with network 130,according to particular needs. In addition, or as an alternative,communication links 140-150 may connect one or more communicationsystems 120 and/or communication devices 122 directly to one or morecloud systems 110 and/or one or more separate communication systems 120and/or communication devices 122.

According to embodiments, one or more communication links 140-150 coupleone or more cloud systems 110, including its administrator 112 anddatabase 114, one or more communication systems 120, and teleconferencespace 160 with network 130. Each communication link 140-150 may compriseany wireline, wireless, or other link suitable to support datacommunications between one or more cloud systems 110 and network 130.Although communication links 140-150 are shown as generally coupling oneor more cloud systems 110 and one or more communication systems 120 withnetwork 130, one or more cloud systems 110 and one or more communicationsystems 120 may communicate directly with each other according toparticular needs.

According to embodiments, network 130 includes the Internet, telephonelines, any appropriate LANs, MANs, or WANs, and any other communicationnetwork coupling one or more cloud systems 110 and one or morecommunication systems 120. For example, data may be maintained by one ormore cloud systems 110 at one or more locations external to one or morecloud systems 110, and made available to one or more cloud systems 110or one or more communication systems 120 using network 130, or in anyother appropriate manner.

According to embodiments, one or more cloud systems 110 and/or one ormore communication systems 120 may each operate on one or more computersthat are integral to or separate from the hardware and/or software thatsupports teleconference system 100. In addition, or as an alternative,the one or more users may be associated with teleconference system 100including one or more cloud systems 110 and/or one or more communicationsystems 120. These one or more users may include, for example, one ormore computers programmed to generate teleconference space 160 andmeasure and transmit the emotional feedback of users participating inteleconference space 160 autonomously. As used herein, the computer, theterm “computer,” and “computer system” comprise an input device and anoutput device. The computer input device includes any suitable inputdevice, such as a keypad, mouse, touch screen, microphone, or otherdevice to input information. The computer output device comprises anysuitable output device that may convey information associated with theoperation of teleconference system 100, including digital or analogdata, visual information, or audio information. According toembodiments, the one or more computers include any suitable fixed orremovable non-transitory computer-readable storage media, such asmagnetic computer disks, CD-ROMs, or other suitable media to receiveoutput from and provide input to teleconference system 100. The one ormore computers also include one or more processors and associated memoryto execute instructions and manipulate information according to theoperation of teleconference system 100.

Embodiments contemplate one or more cloud systems 110 generatingteleconference space 160. Each of the one or more communication systems120 and/or one or more communication devices 122 that comprise eachcommunication system 120 may connect to one or more cloud systems 110using network 130 and communication links 140-150, and may participatein teleconference space 160. Teleconference space 160 enables the one ormore communication systems 120 and/or one or more communication devices122 to conduct and participate in an audiovisual teleconference.Teleconference space 160 may comprise visual component 162, audiocomponent 164, and/or attention component 166. Although teleconferencespace 160 is shown and described as comprising single visual component162, single audio component 164, and single attention component 166,embodiments contemplate teleconference space 160 comprising any numberof components or related information, according to particular needs.

Visual component 162 may comprise video imagery of one or more speakingusers associated with one or more communication devices 122 and/or oneor more communication systems 120. Audio component 164 may compriseaudio from one or more currently-speaking users associated with one ormore communication devices 122 and/or one or more communication systems120. Attention component 166 may comprise information regarding thecurrent level of attention of one or more users associated with each ofone or more communication devices 122 and/or communication systems 120.

According to embodiments, cloud system 110 administrator 112 generatesan outbound teleconference stream, comprising visual component 162and/or audio component 164 of teleconference space 160. Administrator112 transmits the outbound teleconference stream to each of one or morecommunication devices 122 participating in teleconference space 160. Oneor more communication devices 122 use associated audiovisual displaydevices to display the outbound teleconference stream. Each of one ormore communication devices 122 uses an audiovisual recording device(such as, for example, a camera associated with communication device122) to record the facial expression of one or more users associatedwith that communication device 122. In an embodiment, one or morecommunication devices 122 analyze each facial expression, assess itsemotional content, and assign a qualitative value measuring one or morequalities of the facial expression in real time. One or morecommunication devices 122 may transmit this qualitative value of each ofthe one or more user facial expressions to one or more cloud systems 110generating teleconference space 160.

FIG. 2 illustrates cloud system 110 of FIG. 1 in greater detail,according to an embodiment. Cloud system 110 may comprise one or morecomputers at one or more locations including associated input devices,output devices, non-transitory computer-readable storage media,processors, memory, or other components to send and receive informationbetween one or more communication systems 120 and/or one or morecommunication devices 122 according to the operation of teleconferencesystem 100. In addition, and as discussed in more detail below, cloudsystem 110 comprises administrator 112 and database 114. Although cloudsystem 110 is described as comprising single administrator 112 andsingle database 114, embodiments contemplate any suitable number ofadministrators 112 or databases 114 internal to or externally coupledwith cloud system 110. In addition, or as an alternative, cloud system110 may be located internal to one or more communication devices 122.For example, cloud system 110 may be located external to one or morecommunication devices 122 and may be located in, for example, acorporate or regional entity of one or more communication devices 122,according to particular needs.

According to embodiments, administrator 112 comprises administrationmodule 202 and graphical user interface module 204. Although aparticular configuration of administrator 112 is shown and described,embodiments contemplate any suitable number or combination ofadministration modules 202 and graphical user interface modules 204located at one or more locations, local to, or remote from, cloud system110, according to particular needs. In addition, or as an alternative,administration module 202 and graphical user interface module 204 may belocated on multiple administrators 112 or computers at any location inteleconference system 100.

Database 114 may comprise communication systems data 210, teleconferencestream data 212, and device attention data 214. Although database 114 isshown and described as comprising communication systems data 210,teleconference stream data 212, and device attention data 214,embodiments contemplate any suitable number or combination ofcommunication systems data 210, teleconference stream data 212, deviceattention data 214, and/or other data pertaining to teleconferencesystem 100 located at one or more locations, local to, or remote from,cloud system 110, according to particular needs.

Administration module 202 of administrator 112 may configure, update,and/or manage the operation of cloud system 110. That is, administrationmodule 202 may configure, update, and/or manage the broader operation ofteleconference system 100 and change which data is executed and/orstored on one or more cloud systems 110 and/or one or more communicationdevices 122. Teleconference system 100 may comprise a user-configurablesystem, such that cloud system 110 administrator 112 may storecommunication systems data 210, teleconference stream data 212, and/ordevice attention data 214 either singularly or redundantly in cloudsystem 110 database 114 and/or one or more communication devices 122,according to particular needs. According to other embodiments,administration module 202 monitors, processes, updates, creates, andstores communication systems data 210, teleconference stream data 212,and/or device attention data 214 in cloud system 110 database 114.

According to embodiments, administration module 202 of administrator 112may generate teleconference space 160, which one or more communicationdevices 122 may join. When communication device 122 joins teleconferencespace 160, administration module 202 may record unique identifyinginformation regarding communication device 122, such as by assigningcommunication device 122 a unique ID or by recording the IP or MACaddress of communication device 122, in communication systems data 210of database 114, as is further described below.

Graphical user interface module 204 of administrator 112 generates theoutbound teleconference stream, which administration module 202transmits to one or more communication devices 122 using network 130 andone or more communication links 140-150. Graphical user interface module204 accesses teleconference stream data 212 stored in database 114 anduses teleconference stream data 212 to generate an outboundteleconference stream, which administration module 202 transmits to oneor more communication devices 122 participating in teleconference space160. Graphical user interface module 204 stores and retrieves data fromcloud system 110 database 114, including communication systems data 210and outbound teleconference stream data 212, in the process ofgenerating the outbound teleconference stream. Graphical user interfacemodule 204 may generate different graphical user interface displaysconveying different types of information for different communicationdevices 122.

Communication systems data 210 of database 114 comprises theidentification information of one or more communication devices 122,such as, for example, names and addresses of the one or more usersassociated with each of one or more communication devices 122, companycontact information, telephone numbers, email addresses, IP addresses,and the like. According to embodiments, identification information mayalso comprise information regarding the operating systems of each of oneor more communication systems 120, internet browser informationregarding each of one or more communication devices 122 associated witheach of one or more communication systems 120, or system specifications(such as, for example, processor speed, available memory, hard drivespace, and the like) for each of one or more communication devices 122associated with each of one or more communication systems 120.

Communication systems data 210 may also include end user ID information,end user personal identification number (PIN) information, communicationdevice 122 ID information, communication device 122 MAC addressinformation, or any other type of information which cloud system 110 mayuse to identify and track each of one or more communication systems 120and/or one or more communication devices 122 participating inteleconference system 100. Communication systems data 210 may furthercomprise identification data that identifies and tracks each of one ormore communication devices 122 which comprise each of one or morecommunication systems 120. Although particular communication systemsdata 210 are described, embodiments contemplate any type ofcommunication systems data 210 associated with one or more communicationdevices 122 or communication devices 122, according to particular needs.In one embodiment, cloud system 110 uses communication systems data 210to identify one or more participating communication devices 122 inteleconference system 100 in order to aid the selection of one or morecommunication device 122 streams to comprise the outbound teleconferencestream, such as by prioritizing communication device 122 streams ofpredetermined very important person (VIP) communication devices 122. Inanother embodiment, cloud system 110 uses communication systems data 210to generate teleconference space 160 which specifically includes onlyparticular identified communication devices 122, such as in the case ofa private teleconference space.

Teleconference stream data 212 of database 114 comprises data related tothe outbound teleconference stream, which cloud system 110 transmits toone or more communication devices 122. One or more communication devices122 may transmit audiovisual information regarding one or more speakingusers to administration module 202, which may store this information inteleconference stream data 212. Graphical user interface module 204 mayaccess teleconference stream data 212 and use it to generate an outboundteleconference stream, comprising a visual and audio component 164,which administration module 202 transmits to one or more communicationdevices 122 participating in teleconference space 160.

Device attention data 214 of database 114 comprises data related to thecurrent attention status of the communication devices 122 participatingin teleconference space 160. Each of one or more communication devices122 participating in teleconference space 160 may analyze the facialexpression of one or more associated users, assess the emotional contentof each facial expression, and may use the emotional content of eachfacial expression to assign a qualitative value to the level ofattention of each facial expression. According to embodiments, thequalitative attention value may be Boolean in nature (such as, forexample, a binary selection between “attentive” or “inattentive”), ornumerical in nature (such as, for example, by averaging togethermultiple assigned emotion scores to arrive at a percentage value, suchas 75%).

Each of one or more communication devices 122 participating inteleconference space 160 may transmit a qualitative attention value foreach facial expression to cloud system 110. Cloud system 110administration module 202 may store the qualitative attention value ofthe one or more facial expressions associated with each communicationdevice 122 in device attention data 214 of database 114. Graphical userinterface module 204 may access device attention data 214 and use it andteleconference stream data 212 to generate specific graphical userinterface displays.

According to embodiments, one or more communication devices 122 maytransmit a request to administration module 202 of cloud system 110,using network 130 and communication links 140-150, for administrationmodule 202 to generate teleconference space 160. In response,administration module 202 may generate teleconference space 160, andtransmit requests to join teleconference space 160 to one or more othercommunication devices 122 using network 130 and communication links140-150. A plurality of separate communication devices 122 may acceptthe requests and join and participate in teleconference space 160.Embodiments contemplate any number of communication devices 122 joiningand participating in teleconference space 160.

In an embodiment, a user associated with one of one or morecommunication devices 122 uses teleconference space 160 to deliver ateleconference presentation to the users associated with the one or moreseparate communication devices 122 (the presenting user is henceforthreferred to as the “host,” and the particular communication device 122associated with the host as the “host device”). The audiovisualrecording device of the host device records audiovisual informationregarding the host speaking. The host device transmits this audiovisualinformation to administration module 202 using network 130 andcommunication links 140-150. Administration module 202 stores thisaudiovisual information in teleconference stream data 212.

Graphical user interface module 204 accesses teleconference stream data212, comprising visual component 162 and audio component 164 of thehost's audiovisual information. Graphical user interface module 204 usesthis data to generate an outbound teleconference stream, comprisingvisual component 162 displaying the host and audio component 164comprising the host's spoken audio. Administration module 202 transmitsthe outbound teleconference stream to the communication devices 122participating in teleconference space 160. Each of one or morecommunication devices 122 displays the audiovisual content of theoutbound teleconference stream using one or more associated audiovisualdisplay devices.

FIG. 3 illustrates exemplary communication device 122 of FIG. 1 ingreater detail, according to an embodiment. Communication device 122 maycomprise processor 302 and memory 304. Although communication device 122is described as comprising single processor 302 and memory 304,embodiments contemplate any suitable number of processors 302, memory304, or other data storage and retrieval components internal to orexternally coupled with communication device 122.

Communication device 122 processor 302 may comprise audiovisualrecording module 310, facial analysis module 312, emotions analysismodule 314, and transmission module 316. Although processor 302 isillustrated as comprising single audiovisual recording module 310,facial analysis module 312, emotions analysis module 314, andtransmission module 316, embodiments contemplate any suitable number ofaudiovisual recording modules 310, facial analysis modules 312, emotionsanalysis modules 314, transmission modules 316, or other modules,internal to or externally coupled with communication device 122.Processor 302 may execute an operating system program stored in memory304 to control the overall operation of communication device 122. Forexample, processor 302 may control the reception of signals and thetransmission of signals within teleconference system 100. Processor 302may execute other processes and programs resident in memory 304, suchas, for example, registration, identification or communication overnetwork 130 and communication links 140-150.

Communication device 122 memory 304 may comprise audiovisual data 320,facial expressions data 322, emotions data 324, and attention data 326.Although memory 304 is described as comprising audiovisual data 320,facial expressions data 322, emotions data 324, and attention data 326,embodiments contemplate any suitable number of audiovisual data 320,facial expressions data 322, emotions data 324, attention data 326, orother data, internal to or externally coupled with communication device122.

In an embodiment, audiovisual recording module 310 may be operativelyassociated with, and may monitor and facilitate the operation of, theaudiovisual recording device of communication device 122. By way ofexample and not of limitation, audiovisual recording module 310 mayactivate the audiovisual recording device of a host's communicationdevice 122, and may record audiovisual information regarding that hostspeaking to the one or more separate communication devices 122participating in teleconference space 160. In an embodiment, audiovisualrecording module 310 may transmit this audiovisual information to cloudsystem 110 administration module 202, using network 130 and one or morecommunication links 140-150.

Audiovisual recording module 310 may also store audiovisual informationpertaining to one or more users in audiovisual data 320 of communicationdevice 122 memory 304. According to embodiments, audiovisual data 320may comprise visual information, such as a video file or real-timevisual stream, or one or more individual image snapshots, of one or moreusers associated with communication device 122. Audiovisual data 320 mayalso comprise audio information, such as recorded audio of one or morespeaking users. Although particular audiovisual data 320 are describedherein, embodiments contemplate audiovisual recording module 310 storingany form of audiovisual data 320, including but not limited to data thatis exclusively visual in nature or data that is exclusively audio innature, in audiovisual data 320.

Facial analysis module 312 of communication device 122 processor 302 mayanalyze audiovisual data 320 to determine the facial expression of oneor more users associated with communication device 122. Facial analysismodule 312 may access audiovisual data 320, determine whether one ormultiple users are currently associated with communication device 122,and may store information related to each of the one or more user facialexpressions in facial expressions data 322. In an embodiment, facialanalysis module 312 may use facial recognition techniques to separatelyidentify each of the one or more users currently associated withcommunication device 122, and may separately store information relatedeach user's facial expression in facial expressions data 322.

As discussed in greater detail below, facial analysis module 312 maydetermine the status of each user's facial expression by, for example:(1) assigning one or more data points 702, illustrated by FIG. 7, to thefacial structure of individual snapshots or a real-time visual stream ofa user stored in audiovisual data 320, and (2) interpreting assigneddata points 702 in accordance with one or more facial expressiontemplates which may be stored in facial expressions data 322. Althoughparticular procedures by which facial analysis module 312 may analyzeuser facial expression information and store such information in facialexpressions data 322 are shown and described, embodiments contemplatefacial analysis module 312 utilizing any analysis technique to reviewinformation stored in audiovisual data 320 and to convert theaudiovisual data 320 information into facial expressions informationstored in facial expressions data 322, according to embodiments.

Facial expressions data 322 of communication device 122 memory 304stores information regarding the current facial expression of each ofthe one or more users associated with communication device 122,according to an embodiment. Facial expressions data 322 may furthercomprise one or more facial expression templates, which facial analysismodule 312 may use to interpret data points 702 which facial analysismodule 312 has assigned to the facial structure of each user. In anembodiment, one or more cloud systems 110 and/or one or morecommunication devices 122 may transmit one or more facial expressiontemplates to facial expressions data 322.

Facial analysis module 312 may analyze each of the one or more users'facial expressions stored in facial expressions data 322, utilizing oneor more facial expression templates also stored in facial expressionsdata 322, to interpret the presence of one or more emotions associatedwith each user's facial expressions. For example, facial analysis module312 may analyze a particular user's facial expressions for the presenceof specific assigned data points 702 which suggest the user is happy(such as, for example, by determining that a cluster of assigned datapoints 702 around the user's mouth suggest the user is smiling), sad,surprised, neutral, angry, or unfocused. Although particular exemplaryemotions are described herein, embodiments contemplate facial analysismodule 312 analyzing a user's facial expression to detect the presenceof one or more of any possible emotions, according to embodiments.Having assessed the presence of one or more emotions in the user'sfacial expression, facial analysis module 312 stores this emotioninformation in emotions data 324 of communication device 122 memory 304.

According to embodiments, emotions data 324 of communication device 122memory 304 stores information regarding one or more emotions associatedwith each of the one or more users' facial expression. In an embodiment,emotions data 324 may store separate variables for one or more of anypossible emotions, assigned by facial analysis module 312. By way ofexample and not of limitation, facial analysis module 312 may analyze aparticular user facial expression stored in facial expressions data 322and assign separate emotion scores representing a plurality of separateemotions (in this example: happy 78%; sad 21%; surprised 44%; neutral0%; angry, 5%; unfocused 10%). Facial analysis module 312 may store eachseparate emotion scores in emotions data 324. Although particularexemplary emotions and emotion scores are shown and described,embodiments contemplate emotions data 324 storing score informationregarding any number of separate defined emotions, according toparticular needs.

Emotions analysis module 314 of communication device 122 processor 302may access data regarding emotions and emotion scores stored in emotionsdata 324, and may use the data regarding emotions and emotion scores toassign a qualitative attention value indicating whether each particularuser of the one or more users associated with communication device 122is attentive to and following teleconference space 160. Emotionsanalysis module 314 may utilize one or more attention criteria, storedin attention data 326, to assign the qualitative attention value. Forexample, an exemplary attention criteria might specify that if a user'sassessed happiness emotion is greater than 50%, and the user's assessedunfocused emotion is also less than 30%, that user is engaged and isattentively participating in teleconference space 160. Although specificattention criteria are described, embodiments contemplate the emotionalanalysis module utilizing any attention criteria to analyze the emotionsand emotion scores stored in emotions data 324 in order to assign aqualitative attention value. In an embodiment, one or more cloud systems110 or one or more separate communication devices 122 may transmitinformation to emotions analysis module 314, using network 130 andcommunication links 140-150, directing which attention criteria emotionsanalysis module 314 should use to assign a qualitative attention value.Having assigned a qualitative attention value, emotions analysis module314 stores the qualitative attention value in attention data 326 ofcommunication device 122 memory 304.

According to embodiments, attention data 326 may store an assignedqualitative attention value of each of the one or more users'attentiveness to and engagement in teleconference space 160. Attentiondata 326 may also store one or more attention criteria, which may betransmitted to communication device 122 by one or more cloud systems 110and/or one or more separate communication devices 122, and whichemotions analysis module 314 may use to generate a qualitative attentionvalue based on emotions data 324 and the emotion scores stored inemotions data 324 of communication device 122 memory 304. Althoughparticular examples of attention data 326 are described herein,embodiments contemplate attention data 326 comprising any number or typeof attention criteria or qualitative attention values, according toparticular needs.

Transmission module 316 of communication device 122 processor 302 mayaccess the qualitative attention values, stored in attention data 326,of each of the one or more users associated with communication device122. Transmission module 316 may transmit the qualitative attentionvalues to cloud system 110 administration module 202 using network 130and communication links 140-150. In an embodiment, transmission module316 may transmit a qualitative attention value for each of the one ormore users associated with the communication system 120 to cloud system110 administration module 202 every two seconds, permittingadministration module 202 to receive substantially real-time updatesregarding the emotions and attention level of each user participating inteleconference space 160. That is, audiovisual recording module 310,facial analysis module 312, emotions analysis module 314, andtransmission module 316 may continuously carry out and update theactions described above to generate and continuously update aqualitative attention value for each particular user, and to transmitthis qualitative attention value to administration module 202 of cloudsystem 110 every two seconds. In other embodiments, audiovisualrecording module 310, facial analysis module 312, emotions analysismodule 314, and transmission module 316 may generate and transmit aqualitative attention value for a particular user every second, everyten seconds, or at any other interval of time.

Administration module 202 may store the qualitative attention value ofeach of the one or more users associated with each communication device122 participating in teleconference space 160 in device attention data214 of cloud system 110 database 114. According to embodiments, andseparate from the outbound teleconference stream described above,graphical user interface module 204 may access device attention data 214and use it to generate attention component 166 of teleconference space160. Attention component 166 may display the current status of thequalitative attention value of each communication device 122participating in teleconference space 160. In an embodiment,administration module 202 may transmit attention component 166exclusively to the host device. The host device may use its audiovisualdisplay device to display attention component 166 to the host, who mayuse attention component 166 information to alter the ongoingpresentation delivered using teleconference space 160.

FIG. 4 illustrates exemplary method 400 of displaying the qualitativeattention values of one or more communication devices 122, according toan embodiment. Method 400 proceeds by one or more actions, whichalthough described in a particular order may be performed in one or morepermutations or alternative orders, according to particular needs.

At action 402 of method 400, teleconference system 100 generatesteleconference space 160. Communication device 122 transmits a requestto administration module 202, using network 130 and communication links140-150, to generate teleconference space 160. Administration module 202generates teleconference space 160 and transmits, using network 130,requests to join teleconference space 160 to one or more separatecommunication devices 122 that will participate in teleconference space.Each of the one or more separate communication devices 122 accepts therequest to join teleconference space 160 and transmits acceptance toadministration module 202. Administration module 202 records uniqueidentifying information regarding each of the one or more communicationdevices 122, such as by assigning each communication device 122 a uniqueID and/or by recording IP or MAC address of each communication device122 in communication systems data 210. In an embodiment, communicationdevice 122 that transmitted the initial request to generateteleconference space 160 to administration module 202 usesteleconference space 160 to deliver a teleconference presentation to oneor more separate communication devices 122 that joined teleconferencespace 160. Communication device 122 that transmitted the initial requestto generate teleconference space 160 to administration module 202 ishenceforth referred to as the “host device,” and the user associatedwith the host device is referred to as the “host.”

Continuing action 402, the audiovisual recording device of the hostdevice records audiovisual information regarding the host speaking inthe form of visual component 162 and audio component 164. The hostdevice transmits visual component 162 and audio component 164 toadministration module 202 using network 130 and communication links140-150. Administration module 202 stores visual component 162 and audiocomponent 164 in teleconference stream data 212. Graphical userinterface module 204 accesses teleconference stream data 212, whichcomprises visual component 162 and audio component 164 of the host'saudiovisual information. Graphical user interface module 204 uses visualcomponent 162 and audio component 164 to generate an outboundteleconference stream, comprising visual component 162 displaying thehost and audio component 164 comprising the host's spoken audio.Administration module 202 transmits the outbound teleconference streamto one or more communication device 122 participating in teleconferencespace 160. Each of one or more communication devices 122 displays theaudiovisual content of the outbound teleconference stream asteleconference display 602, illustrated by FIG. 6, displayed on anassociated audiovisual display device of each communication device 122.

At action 404, teleconference system 100 chooses relevant user facialexpressions. In an embodiment, the host device selects one or morerelevant user facial expressions by which to measure user attention.Embodiments contemplate host devices selecting any number of user facialexpressions or emotions to measure user attention, according toparticular needs. The host device transmits the host's selection of oneor more relevant user facial expressions by which to measure userattention to administration module 202. Administration module 202transmits the host device's selection of one or more relevant userfacial expressions by which to measure user attention to each of one ormore communication devices 122 participating in teleconference space160. Each communication device 122 stores the selection of one or morerelevant user facial expressions by which to measure user attention incommunication device 122 facial expressions data 322.

At action 406, each communication device 122 participating inteleconference space 160 converts audiovisual data 320 pertaining to oneor more users associated with each communication device 122 into facialexpressions data 322. Audiovisual recording module 310 of eachcommunication device 122 activates the associated audiovisual recordingdevice of each communication device 122 and captures at least visualinformation, such as but not limited to a real-time visual stream and/orindividual visual snapshots, of a user associated with communicationdevice 122. Audiovisual recording module 310 stores the visualinformation in audiovisual data 320. Communication device 122 facialanalysis module 312 accesses audiovisual data 320 and uses audiovisualdata 320 to generate facial expression data 322 pertaining to one ormore facial expressions of one or more associated users. In anembodiment, to generate facial expression data 322, facial analysismodule 312 (1) assigns data points 702 to the facial structure ofindividual snapshots and/or a real-time visual stream of a user storedin audiovisual data 320, and (2) interprets assigned data points 702 inaccordance with one or more facial expression templates stored in facialexpression data 322.

At action 408, teleconference system 100 generates emotions data 324. Inan embodiment, facial analysis module 312 accesses facial expressionsdata 322 and interprets the presence of one or more emotions associatedwith the one or more user facial expressions stored in facialexpressions data 322. Facial analysis module 312 may compare facialexpressions with one or more facial expression templates, stored infacial expressions data 322, to interpolate emotions associated with oneor more facial expressions and to store the one or more emotions inemotions data 324. Other embodiments contemplate facial analysis module312 utilizing any method to analyze facial expressions data 322 and toassign emotions data 324 based on facial expressions data 322, accordingto particular needs.

At action 410, teleconference system 100 generates attention data 326from emotions data 324. In an embodiment, emotions analysis module 314accesses emotions data 324 and assigns attention data 326, in the formof a qualitative attention value, to the emotion scores stored inemotions data 324. According to embodiments, emotions analysis module314 may use any process, including but not limited to combining one ormore emotion scores assigned to emotions data 342 into a single Booleanvalue (such as, for example, “attentive” or “inattentive”), to generatea qualitative attention value. Emotions analysis module 314 stores thequalitative attention value in attention data 326.

At action 412, communication device 122 transmission module 316transmits attention data 326 to administration module 202 of cloudsystem 110. Administration module 202 receives, from each communicationdevice 122 participating in teleconference space 160, attention data 326regarding the one or more users associated with each communicationdevice 122. Administration module 202 stores attention data 326 fromeach communication device 122 in device attention data 214 of cloudsystem 110 database 114. According to embodiments, each communicationdevice 122 may execute actions 406-412 of method 400—that is, convertingaudiovisual data 320 to facial expressions data 322, generating emotionsdata 324 based on facial expressions data 322, generating attention data326 based on emotions data 324, and transmitting attention data 326 toadministration module 202—once every second, once every two seconds,once every ten seconds, substantially continuously, or at any otherinterval of time. By way of example only and not by way of limitation,in embodiments in which each communication device 122 executes actions406-412 once every two seconds, administration module 202 receives anearly-continuous update from each communication device 122 regardingthe current attention data 326 and the qualitative attention value ofthe one or more users associated with each communication device 122.

At action 414, graphical user interface module 204 displays attentiondata 326 from each communication device 112 to the host device. In anembodiment, graphical user interface module 204 accesses deviceattention data 214 and the qualitative attention value of eachcommunication device 122 participating in teleconference space 160.Graphical user interface module 204 uses device attention data 214, aswell as visual component 162 of the outbound teleconference streamstored in teleconference stream data 212, to generate attentioncomponent 166 of teleconference space 160. Attention component 166displays the current status of the qualitative attention value of eachcommunication device 122 participating in teleconference space 160. Inan embodiment, the host device uses its associated audiovisual displaydevice to display attention component 166 to the host as a component ofhost display 1002, illustrated by FIG. 10. Teleconference system 100terminates method 400 when the host teleconference concludes.

In order to illustrate the operation of method 400 and teleconferencesystem 100 displaying the qualitative attention values of one or morecommunication devices 122, an example is now provided. In the followingexample, exemplary teleconference system 100 comprises cloud system 110,five communication devices 122 (in this example, computers 502-510, eachof which comprises a single associated user), network 130, and sixcommunication links 140-149. Although a particular number of cloudsystems 110, communication devices 122, networks 130, and communicationlinks 140-149 are shown and described, embodiments contemplate anynumber of cloud systems 110, communication devices 122, networks 130, orcommunication links 140-149, according to particular needs.

FIG. 5 illustrates exemplary teleconference system 100 executing method400 of FIG. 4, according to an embodiment. Continuing with the example,each of computers 502-510 comprises an audiovisual recording device(comprising a camera and microphone), an audiovisual display device(comprising an electronic display screen and one or more speakers), andan input device (comprising a keyboard). In this example, computer 502acts as the host device (henceforth referred to as “host computer 502”)to conduct the teleconference presentation and to deliver theteleconference presentation to the other four computers 504-510.

Continuing the example, at action 402 of method 400, host computer 502transmits a request to administration module 202, using network 130 andcommunication links 140-150, to generate teleconference space 160.Administration module 202 generates teleconference space 160 andtransmits, using network 130, requests to join teleconference space 160to each of computers 504-510. Each of computers 504-510 transmitsacceptance of the request to join teleconference space 160 toadministration module 202. Administration module 202 records uniqueidentifying information regarding each of computers 504-510, in thisexample by assigning to each of computers 504-510 a unique ID and byrecording the IP or MAC address of each of computers 504-510, incommunication systems data 210.

Continuing the example, and continuing action 402, the audiovisualrecording device of host computer 502 records audiovisual information,in this example comprising visual component 162 and audio component 164,of the host speaking and delivering a presentation. Host computer 502transmits host audiovisual information, including visual component 162and audio component 164, to administration module 202 using network 130and communication links 140-142. Administration module 202 stores theaudiovisual information, including visual component 162 and audiocomponent 164, in teleconference stream data 212. Graphical userinterface module 204 accesses teleconference stream data 212, whichcomprises visual component 162 and audio component 164 of the host'saudiovisual information. Graphical user interface module 204 usesteleconference stream data 212 to generate an outbound teleconferencestream, comprising visual component 162 displaying the host and audiocomponent 164 comprising the host's spoken audio, which administrationmodule 202 transmits to computers 504-510 participating inteleconference space 160. Each of computers 504-510 displays theaudiovisual content of the outbound teleconference stream asteleconference display 602 on the associated audiovisual display device.

FIG. 6 illustrates teleconference display 602, according to anembodiment. In an embodiment, teleconference display 602 displays theoutbound teleconference stream, comprising visual component 162 andaudio component 164, transmitted by administration module 202 to each ofcomputers 504-510. Continuing the example, teleconference display 602comprises presentation window 604 and participant panel 606.Presentation window 604, occupying a large area of the central portionof teleconference display 602 illustrated in FIG. 6, displays visualcomponent 162 of the outbound teleconference stream, in the form ofvideo imagery of the host giving the presentation. Although a particularconfiguration of presentation window 604 is shown and described,embodiments contemplate teleconference displays 602 displayingpresentation windows 604 and/or outbound teleconference stream visualcomponents 162 in any configuration, according to particular needs.

According to embodiments, participant panel 606 on the right side ofteleconference display 602 displays a visual representation ofcommunication devices 122 currently participating in teleconferencespace 160. Participant panel 606 may identify participatingcommunication devices 122 (in this example, computers 502-510) by thenames of the users associated with communication devices 122, or byidentifying communication devices 122 themselves (such as “MiniAndroid,” “Acer One,” and the like). In an embodiment, administrationmodule 202 may assign names to communication devices 122 displayed inparticipant panel 606 using information contained in communicationsystems data 210. Continuing the example, participant panel 606 ofexemplary teleconference stream 602 lists computers 502-510. Although aspecific configuration of participant panel 606 is shown and described,embodiments contemplate teleconference displays 602 displayingparticipant panels in any configuration, according to particular needs.

Continuing the example, at action 404, host computer 502 selects “happy”as the relevant user facial expression by which to measure userattention. Although in this example host computer 502 selects a singleuser facial expression by which to measure user attention, embodimentscontemplate hosts and/or host devices selecting any other user facialexpressions, emotions, or any number of user facial expressions oremotions to measure, according to various needs. Host computer 502transmits the host's selection of “happy” as the relevant user facialexpression to administration module 202, which transmits the selectionto each of computers 502-510 participating in teleconference space 160.Each of computers 502-510 stores the selection of “happy” as therelevant user facial expression in facial expression data 322.

Continuing the example, at action 406, each of computers 504-510converts audiovisual data 320 pertaining to an associated user intofacial expressions data 322. To accomplish this, the audiovisualrecording module 310 of each of computers 504-510 uses the associatedaudiovisual recording device to capture visual information, in the formof a real-time visual stream, the associated user. Audiovisual recordingmodule 310 stores the real-time visual stream in audiovisual data 320.Facial analysis module 312 analyzes the real-time visual stream, storedin audiovisual data 320, to generate facial expressions data 322. Inthis example, facial analysis module 312 analyzes the real-time visualstream by assigning seventy-one data points 702 to the facial structureof the user recorded in the real-time visual stream, illustrated by FIG.7.

FIG. 7 illustrates data points 702 assigned by facial analysis module312 to the real-time visual stream, according to an embodiment.Continuing the example, facial analysis module 312 assigns seventy-onedata points 702 to locate and track facial structure features of theuser recorded in the real-time visual stream. Although this exampleillustrates facial analysis module 312 assigning seventy-one data points702 to audiovisual data 320 comprising a user's face, embodimentscontemplate facial analysis module 312 assigning any number of points toaudiovisual data 320 or using any other method to analyze audiovisualdata 320 in order to generate facial expressions data 322. Continuingthe example, facial analysis module 312 stores the assigned seventy-onefacial expression data points 702, which convey data regarding thecurrent facial expression of the user, in facial expressions data 322.

Continuing the example, at action 408, facial analysis module 312generates emotions data 324 from facial expressions data 322. Facialanalysis module 312 accesses facial expressions data 322 and interpretsthe presence of one or more emotions associated with the facialexpression stored in facial expressions data 322. In this example,facial analysis module 312 compares facial expressions stored in facialexpressions data 322 to facial expression templates, also stored as datain facial expressions data 322, to generate emotions data 324. Otherembodiments contemplate facial analysis module 312 utilizing any methodto analyze facial expressions data 322 and to assign emotions data 324based on facial expressions data 322, according to particular needs.

FIG. 8 illustrates the process by which facial analysis module 312generates emotions data 324 based on the facial structure data points702 stored in facial expressions data 322, according to an embodiment.FIG. 8 comprises data points 702 and emotions data box 802, according toan embodiment. Although FIG. 8 illustrates a particular configuration ofdata points 702 and emotions data box 802, embodiments contemplate anyconfiguration of these, according to particular needs.

Continuing the example, facial analysis module 312 analyzes facialstructure data points 702 stored in facial expressions data 322 andcompares data points 702 to facial expression templates, also stored infacial expressions data 322, to interpret the presence of one or moreemotions. As illustrated in FIG. 8, facial analysis module 312 in thisexample interprets the presence and relative strength of the followingsix emotions data box 802 emotions and assigns the following sixemotional scores: happy 75%; sad 4%; surprised 34%; neutral 22%; angry,8%; unfocused 40%. The facial analysis stores these six emotional scoresdisplayed by emotions data box 802 in emotions data 324.

Continuing the example, at action 410, emotions analysis module 314accesses emotions data 324 and assigns attention data 326, in the formof a qualitative attention value, to the emotion scores stored inemotions data 324.

FIG. 9 illustrates the process by which emotions analysis module 314generates attention data 326 from emotions data 324, according to anembodiment. FIG. 9 comprises emotions data box 802 and attention display902, according to an embodiment. Although FIG. 9 illustrates aparticular configuration of emotions data box 802 and attention display902, embodiments contemplate any configuration of these, according toparticular needs.

Continuing the example, emotions analysis module 314 accesses theemotion scores stored in emotions data 324 emotions data box 802, andcompares the emotion scores to the relevant user facial expressionselected at action 404. In this example, the host selected “happy” asthe relevant user facial expression. Consequently, emotions analysismodule 314 selects the “happy” emotion score of 75%, and saves the happyemotion score as a qualitative attention value in attention data 326. Inan embodiment, graphical user interface module 204 displays the happyemotions score as a qualitative attention value in the form of attentiondisplay 902. In other embodiments, emotions analysis module 314 maystore a Boolean value (such as, for example, “happy” or “unhappy” withregard to the happiness emotion score) in attention data 326, and/or maycombine several emotion scores into a single Boolean value (such as, forexample, “attentive” or “inattentive”) based on an average of severalemotion scores.

Continuing the example, at action 412, transmission module 316 of eachof computers 504-510 transmits attention data 326 pertaining to the userassociated with each computer 504-510 to administration module 202 ofcloud system 110. Administration module 202 receives, from each computer504-510 participating in teleconference space 160, attention data 326regarding the user associated with each computer 504-510. Administrationmodule 202 stores attention data 326 from each computer 504-510 indevice attention data 214 of cloud system 110 database 114. In thisexample, each computer 504-510 executes actions 406-412 of method 400(that is, converting audiovisual data 320 to facial expressions data322, generating emotions data 324 based on facial expressions data 322,generating attention data 326 based on emotions data 324, andtransmitting attention data 326 to administration module 202) once everytwo seconds. In this way, administration module 202 receives anearly-continuous update from each computer 504-510 regarding thecurrent attention data 326 and the qualitative attention value of theuser associated with each computer 504-510. In other embodiments, eachof one or more communication devices 122 participating in teleconferencespace 160 may execute actions 406-412 of method 400 once every second,once every ten seconds, substantially continuously, or at any otherinterval of time.

Continuing the example, at action 414, graphical user interface module204 displays attention data 326 from each computer 504-510 to hostcomputer 502. In an embodiment, graphical user interface module 204accesses device attention data 214 and the current attention data 326 ofeach computer 504-510 stored therein. Graphical user interface module204 uses attention data 326, as well as visual component 162 of theoutbound teleconference stream stored in teleconference stream data 212,to generate attention component 166 of teleconference space 160.Attention component 166 displays the current status of the qualitativeattention value of each computer 504-510 participating in teleconferencespace 160. In an embodiment, graphical user interface module 204 maydisplay attention component 166 in the form of host display 1002attention readout 1004, illustrated by FIG. 10.

FIG. 10 illustrates host display 1002 of teleconference space 160,according to an embodiment. As illustrated by FIG. 10, host display 1002comprises visual component 162 of the outbound teleconference stream,attention readout 1004, and participant panel 606. Although FIG. 10illustrates a particular configuration of host display 1002, attentionreadout 1004, and participant panel 606, embodiments contemplate anyconfiguration of these, according to particular needs.

Continuing the example, host display 1002 comprises visual component 162of the outbound teleconference stream, and additionally displaysattention component 166 in the form of attention readout 1004. Attentionreadout 1004 displays the current qualitative attention value of eachcomputer of computers 504-510 in the form of attention displays 902a-902 d (wherein, in this example, attention display 902 a correspondsto the current qualitative attention value of computer 504, attentiondisplay 902 b corresponds to the current qualitative attention value ofcomputer 506, attention display 902 c corresponds to the currentqualitative attention value of computer 508, and attention display 902 dcorresponds to the current qualitative attention value of computer 510).In this embodiment, attention readout 1004 displays the qualitativeattention value of each computer 504-510 expressed as a percentagevalue. Other embodiments contemplate attention component 166 and/orattention readout 1004 displaying communication device 122 qualitativeattention value in any form (such as, for example, as a Boolean “happy”or “unhappy”) and in any visual configuration, according to particularneeds.

Continuing the example, and according to embodiments, administrationmodule 202 may transmit host display 1002 and/or attention readout 1004exclusively to host computer 502. Host computer 502 may use anassociated audiovisual display device to display host display 1002and/or attention readout 1004 to the host, who may use attentioncomponent 1004, and more specifically attention displays 902 a-902 ddisplayed therein, to alter the ongoing presentation delivered usingteleconference space 160. Teleconference system 100 provides the hostwith nearly real-time updates as to the current emotional status of auser associated with each participating communication device 122, andprovides feedback on the host's presentation through teleconferencespace 160. Concluding the example, teleconference system 100 terminatesmethod 400 when the host teleconference concludes.

Reference in the foregoing specification to “one embodiment”, “anembodiment”, or “some embodiments” means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the invention. The appearancesof the phrase “in one embodiment” in various places in the specificationare not necessarily all referring to the same embodiment.

While the exemplary embodiments have been shown and described, it willbe understood that various changes and modifications to the foregoingembodiments may become apparent to those skilled in the art withoutdeparting from the spirit and scope of the present invention.

What is claimed is:
 1. A system, comprising: two or more communicationdevices; and a computer coupled with a database and comprising aprocessor and memory, the computer configured to generate ateleconference space in which the two or more communication devicesparticipate by: generating a teleconference space; transmitting requeststo join the teleconference space to the two or more communicationdevices; storing in the computer memory identification information foreach of the two or more communication devices; storing audiovisual datapertaining to one or more users associated with each of the two or morecommunication devices; converting the audiovisual data into facialexpressions data; generating emotions data from the facial expressionsdata; calculating at least two emotion scores from the emotions data;generating attention data from the emotions data; transmitting theattention data from each of the two or more communication devices to thecomputer; and displaying the attention data on each of the two or morecommunication devices, wherein the attention data is displayed as aplurality of percentage values, wherein each percentage value of theplurality of percentage values corresponds to each of othercommunication devices participating in the teleconference space.
 2. Thesystem of claim 1, further comprising the system converting theaudiovisual data into facial expressions data by: assigning one or moredata points to the facial structure of one or more faces stored in theaudiovisual data; and interpreting assigned data points in accordancewith one or more facial expression templates.
 3. The system of claim 2,further comprising the system generating emotions data from the facialexpressions data by interpolating emotions associated with the facialexpressions data.
 4. The system of claim 3, further comprising thesystem generating attention data from the emotions data by assigning oneor more qualitative attention values to the emotions data.
 5. The systemof claim 4, further comprising the system averaging the at least twoemotion scores into a single Boolean value to generate attention data.6. The system of claim 5, further comprising the system converting theaudiovisual data into facial expressions data, generating emotions datafrom the facial expressions data, generating attention data from theemotions data, transmitting the attention data from each of the two ormore communication devices to the computer, and displaying the attentiondata once every two seconds.
 7. The system of claim 1, wherein each ofthe two or more communication devices comprises a communication deviceselected from the list of: a computer; a tablet computer; and asmartphone.
 8. A computer-implemented method, comprising: generating,using a computer coupled with a database and comprising a processor andmemory, a teleconference space in which two or more communicationdevices participate; transmitting requests to join the teleconferencespace to the two or more communication devices; storing in the computermemory identification information for each of the two or morecommunication devices; storing audiovisual data pertaining to one ormore users associated with each of the two or more communicationdevices; converting the audiovisual data into facial expressions data;generating emotions data from the facial expressions data; calculatingat least two emotion scores from the emotions data; generating attentiondata from the emotions data; transmitting the attention data from eachof the two or more communication devices to the computer; and displayingthe attention data on each of the two or more communication devices,wherein the attention data is displayed as a plurality of percentagevalues, wherein each percentage value of the plurality of percentagevalues corresponds to each of other communication devices participatingin the teleconference space.
 9. The computer-implemented method of claim8, further comprising converting the audiovisual data into facialexpressions data by: assigning one or more data points to the facialstructure of one or more faces stored in the audiovisual data; andinterpreting assigned data points in accordance with one or more facialexpression templates.
 10. The computer-implemented method of claim 9,further generating emotions data from the facial expressions data byinterpolating emotions associated with the facial expressions data. 11.The computer-implemented method of claim 10, further comprisinggenerating attention data from the emotions data by assigning one ormore qualitative attention values to the emotions data.
 12. Thecomputer-implemented method of claim 11, further comprising averagingthe at least two emotion scores into a single Boolean value to generateattention data.
 13. The computer-implemented method of claim 12, furthercomprising converting the audiovisual data into facial expressions data,generating emotions data from the facial expressions data, generatingattention data from the emotions data, transmitting the attention datafrom each of the two or more communication devices to the computer, anddisplaying the attention data once every two seconds.
 14. Thecomputer-implemented method of claim 1, wherein each of the two or morecommunication devices comprises a communication device selected from thelist of: a computer; a tablet computer; and a smartphone.
 15. Anon-transitory computer-readable storage medium embodied with software,the software when executed configured to: generate, using a computercoupled with a database and comprising a processor and memory, ateleconference space in which two or more communication devicesparticipate; transmit requests to join the teleconference space to thetwo or more communication devices; store in the computer memoryidentification information for each of the two or more communicationdevices; store audiovisual data pertaining to one or more usersassociated with each of the two or more communication devices; convertthe audiovisual data into facial expressions data; generate emotionsdata from the facial expressions data; generate attention data from theemotions data; calculate at least two emotion scores from the emotionsdata; transmit the attention data value from each of the two or morecommunication devices to the computer; and display the attention data oneach of the two or more communication devices, wherein the attentiondata is displayed as a plurality of percentage values, wherein eachpercentage value of the plurality of percentage values corresponds toeach of other communication devices participating in the teleconferencespace.
 16. The non-transitory computer-readable storage medium of claim15, wherein the software when executed is further configured to convertthe audiovisual data into facial expressions data by: assigning one ormore data points to the facial structure of one or more faces stored inthe audiovisual data; and interpreting assigned data points inaccordance with one or more facial expression templates.
 17. Thenon-transitory computer-readable storage medium of claim 16, wherein thesoftware when executed is further configured to generate emotions datafrom the facial expressions data by interpolating emotions associatedwith the facial expressions data.
 18. The non-transitorycomputer-readable storage medium of claim 17, wherein the software whenexecuted is further configured to generate attention data from theemotions data by assigning one or more qualitative attention values tothe emotions data.
 19. The non-transitory computer-readable storagemedium of claim 18, wherein the software when executed is furtherconfigured to average the at least two emotion scores into a singleBoolean value to generate attention data.
 20. The non-transitorycomputer-readable storage medium of claim 19, wherein the software whenexecuted is further configured to convert the audiovisual data intofacial expressions data, generate emotions data from the facialexpressions data, generate attention data from the emotions data,transmit the attention data from each of the two or more communicationdevices to the computer, and display the attention data once every twoseconds.